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Abstract. In 1994, based on Roberts' counterexample to Hilbert's fourteenth problem, 
A'Campo-Neuen constructed an example of a linear actfon of a 12-dimensfonal commu- 
tative unipotent group Hq on a 19-dimensional vector space V such that the algebra of 
I invariants k[V^]-^o is not finitely generated. We consider a certain extension H of Hq 

' by a one-dimensional torus and prove that H is epimorphic in SL(T^). In particular, 

the homogeneous space Sh{V)/H provides a new example of a homogeneous space with 
epimorphic stabilizer that admits no projective embeddings with small boundary. 
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O: 1. Introduction 

We work over an algebraically closed field k of characteristic zero. Throughout the 
paper all topological terms relate to the Zarisky topology, all groups are supposed to be 
algebraic and their subgroups closed. 

Let G be a connected affine algebraic group and H a subgroup of it. We recall that 
a projective embedding with small boundary of the homogeneous space G/H is an open 
G-equivariant embedding p: G/H X, where X is an irreducible normal projective G- 
C<^ ■ variety and codimx {X\p{G / H)) ^ 2. For a given homogeneous space G/H, the existence 

]^ ! of such embedding implies that the algebra k[G/if] of regular functions on G/H consists 

of constants, that is, k[G/if] = k. A subgroup H G G with k[G/if] = k is said to be 
epimorphic. Various characterizations, properties, and examples of epimorphic subgroups, 
O ■ as well as several conjectures and open problems concerning them, can be found in [BBI] . 

[BBII], [BBK], and [Sa §23B]. 

It turns out that not every homogeneous space G/H with epimorphic H admits a 
projective embedding with small boundary. A criterion for this is given by Theorem [1] 
^ ■ below. To formulate this theorem, we need to recall some additional notions. A subgroup 

c3 ! H C G is said to be observable if G/H is a quasi-affine variety. An observable subgroup 

if C G is said to be a Grosshans subgroup if the algebra k[G/if] is finitely generated 
over k. 

Theorem 1. Let H d G be an epimorphic subgroup. Then the following conditions are 
equivalent: 

(a) G/H admits a projective embedding with small boundary; 

(b) there is a character x of H such that Kerx is a Grosshans subgroup in G. 
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A complete proof of this theorem can be found in [Ar| Theorem 1.1]. 

Under a certain assumption on if, a combinatorial classification of all projective em- 
beddings with small boundary for a given homogeneous space G/H is obtained in \Ar\ 
§3]. Another problem arising in connection with Theorem [1] is to construct examples 
of epimorphic subgroups H G G such that the corresponding homogeneous spaces G/H 
admit no projective embeddings with small boundary. In view of condition (b) of Theo- 
rem [H such examples should be based on examples of observable subgroups Hq C G such 
that the algebra k[G'/i/o] is not finitely generated over k. In their turn, examples of this 
kind are provided by linear counterexamples to Hilbert's fourteenth problem. 

We recall that, in general, Hilbert's fourteenth problem asks whether for a subfield L 
of the field K{xi, . . . ,x„) of rational functions in n variables over a field K such that 
L D K the algebra L H K[xi, . . . , x„] is finitely generated over K. (Here K[xi, . . . , Xn] 
is the algebra of polynomials in xi, . . . An important special case of this problem 

asks whether the algebra K[xi, . . . , Xn]'^ of invariants of a linear action of a group G on 
an n-dimensional vector space is finitely generated over K. (This special case is obtained 
from the general one with L being the quotient field of . . . , Xn]'^-) Counterexamples 
to this special case of Hilbert's fourteenth problem are called linear counterexamples. 

At this moment, few counterexamples to Hilbert's fourteenth problem are known. The 
first one, which turns out to be linear, was discovered by Nagata in 1958 [N]. In Na- 
gata's example, a 13-dimensional unipotent group acts on a 32-dimensional vector space. 
Much later, in 1997, Nagata's counterexample was considerably simplified by Steinberg 
[St] whose counterexample is now known as Nagata-Steinberg's counterexample. In this 
example, the dimension of the subgroup is reduced to 6 and that of the vector space to 18. 
The second counterexample, which is not linear, was constructed in 1990 by Roberts jR] 
who used an approach completely different from that of Nagata. In 1994, based on 
Roberts' counterexample, A'Campo-Neuen [X] constructed a linear counterexample in- 
volving an action of a 12-dimensional unipotent group on a 19-dimensional vector space. 
Subsequently, this counterexample was followed by a series of linear counterexamples (see, 
for instance, and references therein). We note that among linear counterexamples to 
Hilbert's fourteenth problem the key role is played by counterexamples involving linear 
actions of unipotent groups. 

A natural way of obtaining examples of homogeneous spaces with epimorphic stabilizer 
that admit no projective embeddings with small boundary is as follows. First, one takes a 
linear counterexample to Hilbert's fourteenth problem involving an action of a unipotent 
group Hq on a vector space V over k. Second, one fixes a connected reductive group G C 
GL(l^) containing Hq. Third, one chooses an appropriate one-dimensional torus S G G 
normalizing Hq such that the subgroup H = SHq is epimorphic in G. In this situation, 
the homogeneous space G/H admits no projective embeddings with small boundary, see 
Proposition [T] in Section [2J 

The first example of a homogeneous space with epimorphic stabilizer that admits no 
projective embeddings with small boundary was mentioned in [BBIh 7(b)]. In this ex- 
ample, G = SL2 X ... X SL2 (16 copies) and H is obtained by extending the group in 
Nagata's counterexample by a one- dimensional torus. An analogous example based on 
Nagata-Steinberg's counterexample was considered (with complete proofs) in [Art § 2] . In 
the present paper, we construct a new example of that kind based on A'Campo-Neuen's 
counterexample. The precise formulations and construction are given in Section [2J 
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In connection with these results the following question may be of interest. 

Question. Let a unipotent group Hq act linearly on a finite- dimensional vector space V 
and let G be a connected reductive subgroup of GL(V^) containing Hq. Suppose that the 
algebra k[V]^'^ is not finitely generated over k. Is there a one- dimensional torus S (Z G 
normalizing Hq such that the group H = SHq is epimorphic in G? 

2. Construction of the subgroup 

We put G = SLi9 and denote by V the space of the tautological representation of G. We 
fix a basis ei, 62, . . . , eig in V. Further on, for any element of G, its matrix is considered 
with respect to this basis. 

Let Ga be the additive group of k. 

We consider a subgroup Hq ~ {GaY"^ embedded in G as follows: 
71 = (/io, Hi,..., /ill) ^ h(jl) = (^j^^jj-^ , 
where i?4, E'ls are the identity matrices of order 4, 15, respectively, and 
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The result of A'Campo-Neuen is as follows. 
Theorem 2 ([X]). The algebra k[V]^'^ is not finitely generated over k. 
Remark 1. In [A] this theorem is proved for any ground field of characteristic zero. 

To construct our example, we consider the one-dimensional torus 
(2) S = {diag(s^^ s-^ . . . , s-^) l s G k^ } C G, 

15 

where k^ = k\{0} is the multiplicative group of k. Clearly, S normalizes Hq. We now 
put H = SHq. The main result of this paper is given by the following theorem. 

Theorem 3. The subgroup H is epimorphic in G. 

This theorem will be proved in Section [31 
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Corollary 1. The homogeneous space G/H admits no projective embeddings with small 
boundary. 

This corollary follows from Theorem |3] and the following proposition. 

Proposition 1. Suppose we are given a linear action of a unipotent group Hq on a 
vector space V overk such that the algebra 'k[V]^° is not finitely generated. Suppose that 
a connected reductive subgroup G C GL(l^) containing Hq is fixed and there is a one- 
dimensional torus S C G normalizing Hq such that the group H = SHq is epimorphic 
in G. Then the homogeneous space G/H admits no projective embeddings with small 
boundary. 

Proof. It suffices to show that condition (b) of Theorem [1] does not hold. This is done by 
the same argument as in [Arl Lemma 2.2]. □ 

3. Proof of Theorem [3] 
Before we prove Theorem [31 let us fix some notation. 

We recall that G = SLig. Let B (resp. U, T) be the Borel subgroup (resp. the 
maximal unipotent subgroup, the maximal torus) in G consisting of all upper triangular 
(resp. upper unitriangular, diagonal) matrices contained in G. Let Ng(T) denote the 
normalizer of T in G, which consists of all monomial matrices contained in G. We denote 
by X{B) the weight lattice of B. The semigroup of dominant weights of B is denoted by 
X+(i?), X+(i?) C X{B). For i = 1, 2, . . . , 18 we denote by tTj the z-th fundamental weight 
of B, which takes every upper triangular matrix to the product of its first i diagonal 
entries. 

The simple G- module with highest weight A G X+{B) is denoted by ^(A), and its 
highest weight vector with respect to B is denoted by vx. Let Px (Z G he the subgroup 
that stabilizes the line {vx) C V^(A). This subgroup is a parabolic subgroup containing 
the Borel subgroup B. We identify the weight lattice X(Pa) of Pa with a sublattice of 
X(P) by means of the natural embedding B Pa. 

Every dominant weight A of P has the form A = aivri + a2vr2 + . . . + aisVTig for some 
non-negative integers ai, 02, . . . , aig. If > for some i G {1,2,.. .,18} then Pa stabilizes 
the line {vTn) C V^ni). At that. Pa acts on v-,,-- by multiplication by the weight vTj. This 
weight takes every matrix A G Pa to the minor corresponding to the first i and last i rows 
and columns of A. (The lower left (19 — i) x i block of A consists of zero entries.) 

In this section, we identify elements s G and their images in S, see ([2]). 

We now proceed to prove Theorem [31 By [Grl Lemma 23.5] it suffices to show that 
there are no proper observable subgroups of G containing H. In view of |Gr| Lemma 7.7] 
the proof will be completed if we check the following two conditions: 

(1) for every non-trivial simple G-module ^(A) and every Borel subgroup B G G the 
highest weight vector of V^(A) with respect to B is not invariant under H; 

(2) there are no proper reductive subgroups of G containing H. 

Condition (1) follows from Lemma [H Condition (2) will be checked using Lemma [21 
We now turn to formulate and prove the lemmas. 

Lemma 1. Let B G G be an arbitrary Borel subgroup and V{X), X ^ 0, an arbitrary 
simple G -module with highest weight vector vx with respect to B. Then there is an element 
h G H such that h ■ vx ^ vx. 
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Proof. Assume that h-vx = v\ for all h E H . Since A 7^ 0, we have A = aiTTj^ +a27rj2 + . . .+ 
a^TTj^, where 1 ^ m ^ 18, 1 ^ zi < ^2 < • • • < ^ 18, and > for alH = 1, . . . , m. 
The subsequent argument is divided into several steps. 

Step 1. Since all Borel subgroups in G are conjugated, there exists an element go E G 
such that B = goBg^^. Then vx = ago ■ vx for some a ^ 0, whence 

(3) go^^9o ■vx = vx 
for all h E H. Consider the Bruhat decomposition of go: 

(4) go = uab, 

where u E U, a E Ng{T), h E B are some fixed elements. We may assume that a = eao, 
where ctq is a permutation matrix, e = 1 for det ctq = 1, and e = e'^^^/^^ for det do = — 1. 
We now substitute expression for go in 1^. Since b multiplies vx by a scalar, we have 

(5) a^^u^^hua ■ Vx = Vx 

for all h E H . Let r: G — )■ G be the map given by the formula T{g) = a^^u^^gua. Taking 
into account ([5]) we obtain r{H) C Pa- 

Step 2. Let u be the permutation of the set {1, 2, . . . , 19} that corresponds to a. Then 
a(ej) = set,(j) for j = 1, . . . , 19. For each pair of matrices g = {gij) E G, g = cr^^gcr we 
have gij = gu{i),,y{j) hJ = {1, • • • , 19}. In particular, g^j = gu{j),uU) for j = 1, . . . , 19. 
We note that under the map g ^'g entries of g lying in the same row (resp. column) are 
transformed into elements of ^ that also lie in the same row (resp. column). 

Step 3. Suppose s E S. Then u~^su is an upper triangular matrix whose diagonal 
entries are s^^, s^^, s^^, s^^, s~^, . . . , s~^. Further, the diagonal entries of the matrix 
r(s) = a~^u~^su(j are again s^^, s^^ , s^^, s^^, . . . , perhaps in another order. At 
that, for every i = 1, . . . , 18 the determinant of the upper left i x i block of r(s) is equal 
to the product of all diagonal entries of this block. Therefore, for every j = 1, . . . , m we 
have TTj^. (r(s)) = s^^ for some hj E Z. Moreover, hj = 15kj — Alj, where 

k, = Mke {1,2,..., z,}\u{k)E {1,2,3,4}} 

and 

l^=^{kE{l,2,...,i,}\u{k)^{l,2,3,A}}. 

Clearly, ^ kj ^ 4, ^ Ij ^ 15, and kj + Ij = ij. The last equality implies that 
{kj,lj) ^ {(0, 0), (4, 15)}, whence bj 7^ for all j = l,...,m. Further, the condition 
'^{s) ■ Vx = Vx implies that A(r(s)) = 1 for all s G S* and aihi + 0262 + . . . + flm^m = 0. 
We conclude that there exists jo £ {1? • • • ? "^} with fej^ > 0. Put i* = ij^, k* = kj^, and 
/* = /jg. Since > 0, we have I* < 15A;*/4, in particular, k* > 0. Obviously, for every 
matrix in t{H) its lower left (19 — i*) x i* block consists of zero entries. 

Step 4. Suppose that u = and u^^ = ' ^^^^^ ^ ^ upper 

unitriangular matrices of order 4 and 15, respectively, R and R' are 4 x 15 matrices, R' = 

—P^^RQ^^. Let h = h(jl) E Ho be an arbitrary element. Recall that h = (^j^^--^ ^ ^ 

for some JI E k^^, where M{jl) is the matrix in ([T]). Then 



u 



Ei + R!M(J1)P P-^R + R'M{JI)R + R'Q 
Q-'M{-p)P + Q-'M{-p)R 
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We consider the 15 x 4 matrix D = D{h) = Q^^M{jl)P. Note that for every entry dpq of 
D we have dpq = rupg + 'Y^CijUiij where the sum is taken over all pairs with i ^ p, 
j ^ q, and 7^ {p,g), the coefficients Cij being uniquely determined by the matrix u. 
Now, using the latter observation and the explicit form ([T]) of the matrix M{jl), we can 
successively choose elements /in, /iio, /ig, /is, /i?, fJ'O, /^e, /^s, yU45 /^s? fJ^2, /ii G k in such a 
way that, for the corresponding element ho G Hq, the submatrix D{ho) of u~^hou has the 
form 
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where the asterisks stand for non-zero entries and the diamonds stand for the entries that 
are irrelevant for us. 

Step 5. We now turn to the element Hq G Hq and the corresponding matrix D{ho) found 
at the previous step. For n = 1, 2, 3, 4 we define numbers Z{n) as follows. We consider all 
15 X n submatrices of D{ho)- For each of them, we count the number of non-zero rows. 
At last, we put Z{n) to be the minimal among the obtained values. Using the explicit 
form dHD of D{ho), we find that Z(l) ^ 4, Z(2) ^ 8, Z{3) ^ 12, Z(4) = 15. 

Step 6. For j = 1, . . . , /c* we define (pairwise distinct) numbers rii, . . . , Uk* G {1, . . . ,i*} 
by the condition z/(nj) = j. The column j of the matrix u'^h^u is obtained by applying 
the permutation v to the column Uj of the matrix tQiq) = a^^{u^^hQu)a (j = 1, . . . , k*). 
Therefore, none of the elements of DQiq) is such that its image under the transformation 
u~^hoU (T~^{u~^hQu)a is contained in one of the rows rii, . . . ,nk*. Since the lower left 
(19 — i*) X i* block of T{hQ) is zero [Step 3), it follows that there is a 15 x k* submatrix 
of D(ho) whose number of non-zero rows is at most i* — k* = I* < 15A;*/4. 

Step 7. Comparing the results of the previous step with the definition of the numbers 
Z{n) {Step 5) we get the following inequality: 



(7) 



Z{k*) < 15F/4. 



Making use of the estimations of Z{n) obtained at Step 5, we find that none of the 
possible values k* = 1,2,3,4 satisfies (JT]). This contradiction completes the proof of the 
lemma. □ 



Thus condition (1) is checked. 
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Lemma 2. Suppose that F C G is a reductive subgroup containing H. 
irreducibly on V. 



Then F acts 



Proof. Since F is reductive, its action on V is completely reducible. Therefore it suffices 
to show that V contains no proper subspaces invariant under F. 

Let Vi C be the subspace spanned by the vectors 61,62,63,64 and V2 C V he the 
subspace spanned by the vectors 65,63, . . . ,619. Clearly, = Vi © V2, dimV^i = 4, and 
dimV2 = 15. We note that both of the subspaces Vi,V2 are invariant under the action 
of S. 

Suppose that W G V is a subspace invariant under F and choose an arbitrary vector 
w & W. Then w = Vi + V2 for some vectors Vi G Vi and f2 G V2. Acting on w 
by the element {y/—T, a/— T, "\/— T, 1, 1, • • • , 1) E S C H C F, we obtain the vector 

w' = \/—lvi + V2 that also lies in W. It follows that both vectors Vi, V2 lie in W. Therefore 
W is the direct sum of its projections Wi and W2 to the subspaces Vi and V2, respectively. 
Clearly, Wi = W nVi and W2 = W nV2. 

Let w G Wi he an arbitrary element. Then for every h E Howe have h-w = w + v{w, h), 
where v{w, h) G W2. Regard the set Hq as a vector space. We define the map ip^'- Hq ^ 
W2 by (pw{h) = v{w, h). In other words, for w = a^ei + 0262 + 0363 + 0464 and /I G k-*^^ we 
have 



(8) 



( c^A 

a2 
03 
\a4/ 



Evidently, is a linear map, therefore its image is a subspace in W2- Besides, 
(9) dim Ker + dim Im = dim Hq = 12. 

To find dim Ker (and thereby dimlmyj^), it is sufficient to solve the linear system 
Vw{h{jl)) = in variables Ji. It is not hard to see that the dimension of the solution space 
of this system depends only on the arrangement of non-zero coordinates of w. The values 
of dim Im ip^ for different types of w G Vi are presented in Table [TJ In the first row of 
this table ly's are written as column vectors, the asterisk denotes a non-zero coordinate. 

TABLE 1. 
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We now assume that V = W ® W for some proper subspaces W, W C V invariant 
under F. Put Wi = W nVi, W2 = W n V2, W[ = W' ^ 14, and W'^ = W' V\ V2. It follows 
from the above that Vi = Wi ® W[ and V2 = © W^2- Without loss of generality we 
may assume that dim 14^1 ^ dimiy^(. Further we consider three possible cases. 

Case 1. dimVTi = 2, dimW^ = 2. Then there are two vectors wi G Wi, w[ G W{ 
such that each of them has at least two non-zero coordinates. From Table [1] we find 
that dimlmy^^^ ^ 8 and dimlmy^^;^ ^ 8. On the other hand, Im (^^^ , Im (yj^^ C V2 and 
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dim V2 = 15, whence the space Imy^^j CilnKp^i^ has positive dimension. This is impossible 
because Imyj^^ C W2, lm^Pw[ C W2, and 14^2 H = {0}- 

Case 2. dimWi = 3, dimiy{ = 1. Then there are a vector wi G Wi with at least 
three non-zero coordinates and a non-zero vector w[ G W^. From Table [1] we find that 
dimlmyj^j ^ 12 dimlmc/?^^ ^ 4. By the same reason as in Case 1, the space Imyj^^ fl 
Imyj^^ has positive dimension, a contradiction. 

Case 3. dimpyi = 4, dimVT^ = 0. It is easy to see that the space Imy^ei contains the 
vectors 65, eg, eg, eg, en, ei2, e^, eis, eie, e^, eig, the space Imf/^gj contains the vector ey, the 
space Imy^eg contains the vector eio, and the space Im99e4 contains the vectors 613, eig. 
Thus all the basis vectors of V lie in W, whence W = V and W = 0, a contradiction. 

In all the cases we have come to a contradiction, so the proof of the lemma is completed. 

□ 

We now show that a reductive subgroup F G G containing H coincides with G. First, 
we note that there are no non-trivial bilinear forms on V preserved by F because this 
holds even for S. Next, by Lemma [2] the F-module V is simple. Therefore the center of 
F is finite and F is semisimple. Moreover, F is simple since otherwise the dimension of 
V would be a composite number, which is not the case (we have diml^ = 19). Obviously, 
the rank of F is at least two. Further, F contains the unipotent subgroup Hq of dimension 
12, whence dimF ^ 2 + 2 ■ 12 = 26. 

Assume that F ^ G. Since there are no non-trivial bilinear forms on V preserved by 
F, it follows that F can only be of type SL^, Spin4;_,_2, or Eq (see [ QV, §4.3]). Further 
we consider these three cases separately. (In all the cases below, our arguments rely on 
well-known facts from representation theory of semisimple algebraic groups.) 

1) F is of type SL^. Clearly, k ^ 18. Since dimF ^ 26, we have k ^ 6. Every simple 
SLfc-module W with dimW^ > k + 1 has actually dimension at least k{k — l)/2, which is 
more than 19 for k ^ 7. It remains to consider the case /c = 6. Every simple SLg-module 
W with dimVT > 15 has actually dimension at least 20. 

2) F is of type Spin4;_,_2. Clearly, / ^ 4. Since dimF ^ 26, we have / ^ 2. Every simple 
Spin^^g-module W with dim 14^ > 18 has actually dimension at least 153. Every simple 
Spin]^4-module W with dimVT > 14 has actually dimension at least 64. Every simple 
Spin^^Q-module W with dim W > IQ has actually dimension at least 45. 

3) F is of type Eg. Every non-trivial simple Eg-module has dimension at least 27. 

In all the cases we have obtained that V is not a simple F-module. This contradiction 
implies that F = G = SL19. 

Thus, we have checked condition (2). Theorem [3] is proved. 
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